Feat/fiftyone classification #379
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose
Expand the parse and export suite with more classification formats that are accepted by FiftyOne. These include three new formats:
classification_directory_parserwas able to do this if these sub-folders were divided into train/valid/test/ subdirectories, now this works with a flat structure. The splits are generated at parse-time randomly.datafolder and alabels.jsonresiding in eachdatafolder where the images reside and alabels.jsonfile. Again the splits are randomly assignedI did not have to implement the mechanism that randomly assigns splits for flat directory structure because this is handled by the LuxonisDataset
make_splits()method which only assigns splits to unassigned ids. Here the default ratio is{"train": 0.8, "val": 0.1, "test": 0.1}Specification
Dependencies & Potential Impact
Deployment Plan
Testing & Validation
After parsing then exporting, then opening a session with the exported datasets:
MNIST:

Caltech101:

Imagenet-sample:
